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Abstract 

Academic institutions and research funders have in the last decade devoted 
considerable effort to developing policies to support academic integrity and 
prevent misconduct. In this study, we consider the extent to which various 
initiatives of Canadian federal and provincial (Quebec) funders have affected 
the development of institutional research integrity/misconduct (RIM) poli¬ 
cies. Examining the creation and modification dates of 32 institutional RIM 
policies, we find that federal but not provincial initiatives appear to have the 
greatest impact on the development of RIM policies. Idiosyncrasies in the 
creation dates, as well as lack of evidence of a systematic pattern in modifi¬ 
cation dates, suggest a complex system that is often insulated from certain 
government initiatives. These results lead us to conclude that there should be 
greater consistency in the development or updating of RIM policies to ensure 
the appropriate treatment of misconduct and to encourage behaviour that 
meets the highest standards of research integrity. 

Resume 

Au cours de la derniere decennie, les institutions academiques et les bailleurs 
de fonds de recherche ont consacre beaucoup d’efforts a l’elaboration de 
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politiques pour soutenir l’integrite scientifique et prevenir les inconduites 
en recherche. Dans la presente etude, nous analysons dans quelle mesure 
les diverses initiatives des bailleurs de fonds canadiens, tant federaux que 
provinciaux (Quebec), ont affecte l’elaboration de politiques institutionnelles 
sur l’integrite et les inconduites en recherche (HR). En examinant les dates 
de creation et de modification de 32 politiques institutionnelles sur 1 ’IIR, 
nous constatons que ce sont les initiatives federates, et non provinciates, 
qui semblent avoir le plus grand effet sur l’elaboration de politiques. Des 
idiosyncrasies dans les dates de creation, ainsi que l’absence de preuves d’un 
modele systematique de dates de modification, suggerent un systeme complexe, 
souvent isole de certaines initiatives gouvernementales. Ces resultats nous 
amenent a conclure qu’il devrait y avoir une plus grande coherence dans 
l’elaboration ou la mise a jour de politiques sur 1 ’IIR pour assurer le traitement 
approprie des inconduites et encourager un comportement qui repond aux 
normes les plus elevees d’integrite en recherche. 

Introduction 

Concern on the part of academics, institutions, funders and the public regarding the 
integrity of research findings and practices has been stimulated in part by high-profile 
and mediatised cases of misconduct (e.g., Callaway, 2011; Jasanoff, 2010; Lock, Wells, 
& Farthing, 2001; Medawar, 1976; Normile, 2014; Snyder & Loring, 2006). In the North 
American context, the US government initiated concerted efforts in the 1980s to study 
the governance mechanisms (i.e., policies and procedures) of research integrity systems 
within American research institutions (CHPS Consulting, 2000; Greene, Durch, Horwitz, 
& Hooper, 1985; Lind, 2005). This ted in the United States to the development of an ac¬ 
tive research community studying integrity (also known as the responsible conduct of 
research), and to the development and implementation of formal governance structures 
at both the federal (e.g., the Office of Research Integrity) and state levels, as well as in 
institutions, to address research integrity/misconduct (RIM; e.g., LaFollette, 1994; Ste- 
neck, 1994). 

In comparison with the United States, Canada’s RIM policy landscape is much less 
clear, in large part because this subject has received far less attention from scholars and 
only in the last decade (Hickling Arthurs Low, 2009; Pencharz, 2007; Schoenherr & Wil- 
liams-Jones, 2011). This situation is problematic given that Canada ranks high among 
nations in terms of investment in science education and there is a considerable degree 
of return on investment in scientific research (King, 2004). Like their American coun¬ 
terparts, Canadian academic institutions all have relevant RIM policies and procedures 
(regarding, for example, conflict of interest, intellectual property, and research ethics), 
but the connection between these institutional policies and provincial or federal govern¬ 
ment initiatives (e.g., the Tri-Agency Framework: Responsible Conduct of Research, Tri- 
Council, 2011) is not at all clear. Research on the state of research integrity in Canada is 
thus needed (Master, McDonald, & Williams-Jones, 2012). 

Whereas the scientific integrity system in the United States represents an important 
landmark for laying out a set of interactions between academia and government, the Ca¬ 
nadian context presents a unique set of considerations, due to differences in public poli- 
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cies as well as government and academic relationships. In this paper, we examine the 
extent to which the actions of research institutions or central authorities affect the devel¬ 
opment of RIM policies at Canadian higher education institutions. To narrow our focus, 
we have limited our investigation to those policies developed by federal granting agencies 
(i.e., by the Tri-Council members) and one provincial funder (i.e., the Fonds de recherche 
du Quebec [FRQ]) to study the impact on the development of RIM policies. Quebec was 
chosen as a case study for a number of reasons: (1) the FRQ funds a substantial amount of 
research (mirroring the scope, if not the depth, of funding by the three agencies); (2) the 
health-funding branch of the FRQ, the Fonds de recherche en sante du Quebec (FRSQ, 
now the FRQ-S), has been very active in promoting research ethics and integrity and in 
providing guidance regarding RIM policies for the Quebec academic community (e.g., 
by developing a key document in 2003); (3) French is the official language in Quebec, so 
provincial government documents might have particular influence on institutions; and 
(4) the Quebec judicial system is based on a civil code, which could add force to certain 
elements of RIM policies. 

The Tri-Council and FRQ require academic institutions that receive funding from 
these sources to develop and implement research integrity policies. However, as noted in 
the literature on policy implementation (e.g., Palumbo & Calista, 1990; Palumbo & Olive- 
rio, 1989; Scheirer, 1987), local institutional contexts can significantly change the nature 
of a policy due to the need to accommodate different stakeholders (Cohen, March, & Ol¬ 
sen, 1972; Kingdon, 2002; Kraatz & Zajac, 1996,2001). Without detailed evaluation, it re¬ 
mains unclear what is actually included in these policies (Schoenherr & Williams-Jones, 
2011), whether and how they are implemented, and how effective they are at preventing 
and managing instances of misconduct. 

Despite the potential variability in an organization’s approach to addressing a par¬ 
ticular concern, organizations often appear to adopt highly similar solutions to policy 
problems (DiMaggio & Powell, 1983; Pfeffer & Salancik, 1978/2003). For instance, Starr’s 
(1982) history of American medical education demonstrates a shift from considerable or¬ 
ganizational diversity and competition to a contemporary model that is far more homoge¬ 
neous and centralized. Rather than being an institution responding to the needs of its aca¬ 
demic community in isolation, it must also adapt to the larger social and policy landscape. 
Thus, change can also result from a desire for legitimacy rather than a wish to solely or 
specifically improve organizational operations (Kraatz & Zajac, 2001; Meyer & Rowan, 
1977; Suchman, 1995). Given our previous policy analysis (Schoenherr & Williams-Jones, 
2011), it does not appear that the content of RIM policies reflects a move toward homo¬ 
geneity. Instead, it is likely that policy innovations reflect some form of a diffusion pro¬ 
cess (Kadushin, 2012; Rogers, 2003; Valente, 1995). Specifically, we suggest that the RIM 
policy adoption pattern in North America reflects both a social contagion process within 
research communities (e.g., fields, disciplines) and a response by organizations (i.e., uni¬ 
versities) to perceived external demands that reflect the concerns of federal funders (e.g., 
for greater institutional accountability). 1 This observation has important implications for 
the modelling of policy-creation behaviour. 

In the present study, we examine the dates in which 47 Canadian university RIM poli¬ 
cies were created (between 1985 and 2006) and compare them to federal and provincial 
(specifically, Quebec) governance policies developed during the same time period. These 
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policies were previously sampled from a listing of the 50 highest ranked universities, us¬ 
ing RE$EARCH Infosource (www.researchinfosource.com), and then analyzed in terms 
of content to determine the features of institutional mechanisms developed to address 
research misconduct (Schoenherr & Williams-Jones, 2011). In our previous study, we 
noted that the release of a research misconduct policy by a federal granting agency was 
cited in some university policies as an impetus for their creation. To examine whether 
the evolution of university policies supports this claim, the current study assessed RIM 
policies before and after the release of key federal and provincial policies. Policy dates 
were summarized in a cumulative distribution function, wherein the frequency of policy 
creation for each date represented the number of policies created in that year, in addi¬ 
tion to policies created for all years preceding that date. This procedure allowed us to 
identify and test a number of functions that represented theoretically important patterns 
of institutional policy-creation behaviour (Rogers, 2003; Valente, 1995), to distinguish 
between the various factors that affect policy adoption (e.g., DiMaggio & Powell, 1983). 
For instance, we could examine whether policies were randomly adopted over a period of 
time (linear increase) or whether there were periods of rapid policy creation (non-linear 
increase). We took the latter as evidence for the importance of factors that were external 
to an institution (i.e., the release of government policies). 

The pattern of policy creation dates obtained by our study clearly shows a period of 
rapid policy creation following the release of a Tri-Council policy in 1994. These findings 
support the view that in the context of Canada’s higher education system, an important 
role is being and can be played by central authorities in promoting a comprehensive sci¬ 
entific integrity system for the research community (see, e.g., Bechner & Kogan, 1992). 

Canadian Research Integrity/Misconduct Policies 

Initiatives on the part of American government agencies, such as the Public Health 
Services (1986) and the National Science Foundation (1987), led to the development of 
centralized mechanisms (notably the Office of Research Integrity) capable of investigat¬ 
ing alleged cases of scientific misconduct, and these developments have had an important 
impact on the American research integrity system and on the policies implemented by 
academic institutions. But the Canadian context is quite different, lacking as it does such 
a central authority; nor is it clear what the key motivating factors were in the creation of 
current RIM policies and governance mechanisms in the Canadian academic community. 

It is intriguing to note that in Canada, federal policies—such as those developed by 
Agriculture and Agri-Foods Canada in 2005, or the Canadian Food Inspection Agency in 
2010—vary in terms of whether they outline explicit measures for investigating cases of 
misconduct, and the extent to which these policies can perform an integrative function so 
that multiple existing policies are explicitly linked together. Other federal policies related 
to integrity, such as the Values and Ethics Code for the Public Sector (Government of Can¬ 
ada, 2012b), the Federal Accountability Act (Government of Canada, 2006), the Policy 
on Conflict of Interest and Post-Employment (Government of Canada, 2012a), and the 
Directive on Conflict of Interest and Post-Employment (Government of Canada, 2014), 
or the Public Servants Disclosure Protection Act (Government of Canada, 2005; updated 
in 2012) are limited to addressing concerns related to scientists and personnel working in 
these government organizations and so are unlikely to have an impact on the behaviour of 
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the academic community working in non-government research centres or in universities. 
Similarly, while documents produced by the Council of Science and Technology Advisors 
(CSTA), such as Science Advice for Government Effectiveness (SAGE; CSTA, 1999) and 
S&TExcellence in the Public Sector (STEPS; CSTA, 2001), have developed a best-practice 
framework for the use of scientific results in evidence-based decision-making (see also 
Health Canada, 1999), they have not outlined norms for the regulation of scientific activity. 

Nonetheless, broad policy statements have been made by professional organizations, 
such as the Canadian Federation for the Humanities and Social Sciences (CFHSS) with 
their Statement on Research Ethics and Scholarly Integrity (2006). Such general poli¬ 
cies can be contrasted against more specific policies, such as the National Research Coun¬ 
cil’s Research Integrity Policy (National Research Council, 1996/2013), or reports by the 
Canadian Association of University Teachers (2003; see also Savage 1994/2003) and the 
Council of Canadian Academies (2010), wherein specific forms of misconduct and regula¬ 
tory considerations are discussed. 

Two recent reviews of the Canadian policy landscape have provided insight into the 
general structure of RIM governance. The first, broader review was conducted by the Hick- 
ling Arthurs Low (HAL) consulting group (2009) and examined the policies of academic, 
government, and private-sector research institutions. This review concluded that the RIM 
system in Canada is characterized by a decentralized approach that is defined by codes of 
conduct, guidelines, and policies that function at an institutional level. Importantly, the 
HAL report identified one policy of a national granting agency, i.e., the Tri-Council Policy 
Statement: Integrity in Research and Scholarship (TCPS-IRS; Tri-Council, 1994), as the 
locus of the RIM system and concluded that this structure was adequate for addressing 
concerns of misconduct in the Canadian academic community. 

In a more focused analysis of RIM policies developed by academic institutions (Schoen¬ 
herr & Williams-Jones, 2011), we documented the elements contained within these poli¬ 
cies (e.g., applicability statements, procedures for submitting allegations, inquiry and 
investigation mechanisms) as well as their objectives. Of the institutions that had RIM 
policies (87.2%), the majority stated their objectives (92.7%). Interestingly, though, only 
50% explicitly referred to Tri-Council initiatives as the impetus for their policy, with an 
additional 31.6% stating funders in general. Taken together with the finding that policy 
areas were not consistently covered in all policies (e.g., ranging from 2.6% to 100%), it 
is unclear to what extent institutions were influenced by the release of the TCPS-IRS in 
1994, in the same way that American institutions were influenced by the PHS and NSF 
initiatives in the late 1980s. 

Local Responses: Institutional Initiatives 

The Canadian RIM system has been characterized as decentralized but with “an in¬ 
fluential locus of policy coordination and leadership that resides with the three federal 
granting councils” (HAL, 2009, p. 7). Specifically, institutions are each responsible for the 
development and administration of their own RIM policies. Information on institutional 
responses to reports of research misconduct is, however, limited, making it difficult to as¬ 
sess the factors that are responsible for the development of these policies. In Canada, one 
of the only documented cases of misconduct leading to policy development was provided 
by Pencharz (2007). Commissioned by Memorial University of Newfoundland, Pencharz 
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conducted an independent review of six existing Canadian policies to determine whether 
those of Memorial University were comparable to those of other institutions and to the 
standards set out by the TCPS-IRS (1994, updated 2005) more generally. This review oc¬ 
curred in response to the repeated falsification of research by Dr. Ranjit Chandra (Smith, 
2005). In the end, the case as well as the review motivated the development of a more 
comprehensive institutional policy (Pencharz, 2007). 

In assessing this case, it is important to note that the response of Memorial University 
could be non-representative. Institutions might be more or less proactive in their devel¬ 
opment of policies and other measures. For instance, the 1985 publication date of McGill 
University’s RIM policy might suggest a response to ensure compliance with American 
policies (e.g., of the NSF) so that the university could continue to receive funding, rather 
than a response to unpublicized cases of research misconduct. Moreover, even though 
misconduct might be detected, institutions could also choose not to develop a compre¬ 
hensive response, preferring instead to treat each instance on a case-by-case basis. This 
latter approach would likely be a result of believing that instances of misconduct are suf¬ 
ficiently rare that the investment of time and financial resources in developing/updating 
policies is not justified. 

Nonetheless, the external funding received by universities—whether Canadian or 
American—obliges these institutions to adhere to the terms of the agreements made with 
funders, and these terms now invariably include the promotion of ethical research and 
academic integrity, and the prevention and management of research misconduct. The 
creation of institutional RIM policies thus appears, at a minimum, to be influenced by 
interactions with external stakeholders. 

External Responses: Federal and Provincial Funding Agencies 

Unlike the American institutional integrity system—wherein the federal Office of Re¬ 
search Integrity (ORI) acts as a central agency that establishes regulations, procedures, 
and appropriate sanctions for misconduct—Canada’s integrity system has no equivalent 
central authority. Instead, a collaborative organization of three federal funding agencies, 
known as the Tri-Council—i.e., the Social Sciences and Humanities Research Council 
(SSHRC), the Canadian Institutes of Health Research (CIHR), and the Natural Sciences 
and Engineering Research Council (NSERC)—provides some central coordination and 
leadership but without the full investigatory powers of the ORI. Specifically, the Panel on 
Research Ethics (which is responsible for the Tri-Council Policy Statement: Ethical Con¬ 
duct for Research Involving Humans, second edition [TCPS2]) and the Panel on Respon¬ 
sible Conduct of Research (which is responsible for the Tri-Agency Framework: Respon¬ 
sible Conduct of Research [TAF-RCR], formerly the TCPS-IRS) set national standards 
and guidelines for research ethics and integrity. 

The key Canadian research integrity guideline in the 1990s was the Tri-Council Policy 
Statement: Integrity in Research and Scholarship (TCPS-IRS; Tri-Council, 1994), re¬ 
placed in 2011 by the Tri-Agency Framework: Responsible Conduct of Research (TAF- 
RCR; Tri-Council, 2011). The TCPS-IRS—and the more detailed TAF-RCR—outlined the 
general principles of responsible scientific practice for researchers receiving Tri-Council 
funding, as well as the responsibilities of institutions who administer these funds. Princi¬ 
ples included appropriately acknowledging others’ contributions (including authorship), 
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revealing potential conflicts of interest, and maintaining rigour throughout the research 
and reporting process. Institutional responsibilities required by the TCPS-IRS included 
promoting research integrity, investigating allegations of misconduct, and reporting on 
the investigation outcomes to the appropriate funding council. A companion document 
to the TCPS-IRS statement, entitled Framework for Tri-Council Review of Institutional 
Policies Dealing with Integrity in Research (Tri-Council, 1996) contained more specif¬ 
ic guidelines. The other major federal document was the Tri-Council Policy Statement: 
Ethical Conduct for Research Involving Humans (TCPSi, Tri-Council, 1998/updated in 
2010 and 2014; TCPS2, Tri-Council, 2014), which was developed specifically to address 
the ethical complexities of research involving human participants. 

But provinces have also taken leadership roles in developing resources and guidelines 
on research integrity for their academic communities. A notable example is Quebec, where 
in 1998 the Ministry of Health and Social Services produced a Plan d’action ministeriel en 
ethique de la recherche et en integrite scientifique (Gouvernement du Quebec Ministere 
de la Sante et des Services sociaux, 1998), followed in 2003 by the Guide d’ethique de 
la recherche et d’integrite scientifique from the Fonds de recherche en sante du Quebec 
(FRSQ, now the FRQ-S), which outlined comprehensive measures regarding research 
integrity. 2 Both of these documents could be sources of motivation for the creation of 
institutional RIM policies in Quebec. In the same manner as the Tri-Councils, the FRSQ 
later revised and updated these standards with the publication of Standards du FRSQ sur 
Tethique de la recherche en sante humaine et Vintegrite scientifique (2008/2009). These 
standards make explicit reference to articles in the Quebec civil code and associated poli¬ 
cy statements while delegating responsibility for the investigation of cases of misconduct 
to individual academic institutions. 3 

The major focus of our study concerns whether these standards were cited, so it re¬ 
mains an open question whether these documents were in fact an impetus for institu¬ 
tional policy creation. Consequently, a preliminary examination was conducted of the 
inception dates of Canadian institutional policies to determine whether they followed the 
creation of these federal and Quebec guidelines and standards. 

Policy Creation Dates 
TCPS-IRS Federal Policy Initiative: Creation Date 

Examination of document inception dates (see Schoenherr & Williams-Jones, 2011) 
revealed that of the academic institutional RIM policies that indicated this information 
(n = 32/47), nearly half (n = 15) were approved within a year of the TCPS-IRS release in 
1994 ( Mode = 1995; Mdn = 1995). The extremely limited range of policy release dates, 
and the fact that the modal value occurs within one year of the TCPS-IRS, suggest that the 
TCPS-IRS might have played a crucial causal role in the creation of individual institution¬ 
al policies. Importantly, as seen in Figure 1, the 1996 release date of the TCPS companion 
document, the Framework for Tri-Council Review of Institutional Policies Dealing with 
Integrity in Research (TCPS-FIR), resulted in no policy creation in 1996 or 1997. This is 
notable given that the TCPS-FIR lays out explicit procedures for investigating allegations 
of misconduct. 
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Figure l. Bars represent RIM policy creation and modification date frequency. The best- 
fit three-parameter sigmoid function is plotted against the cumulative distribution func¬ 
tion (CDF, represented by triangles). 

Diffusion modelling: curve fitting to cumulative distribution function. To examine 
the patterns of policy creation by academic institutions, we used a diffusion modelling 
procedure (e.g., Rogers, 2003; Valente, 1995). First, policy creation dates were summed, 
creating a cumulative distribution function. Functions were fitted for the data points us¬ 
ing SigmaPlot, and R 2 values were obtained to examine the proportion of variance ac¬ 
counted for in the data by the respective curves. Seven candidate models were selected. 
(1) A linear model was selected to determine whether policies were adopted in a more or 
less continuous fashion over the period examined (i.e., 1985 to 2006). (2) To consider the 
possibility that policy-creation behaviour consisted of two different linear trends before 
and after the publication of the TCPS-IRS in 1994, we also applied a piecewise two-seg¬ 
ment linear function. (3) A three-segment linear function was used to reflect differences 
in policy-creation patterns before, during, and following the release of the TCPS-IRS in 
1994. (4) The logarithmic function in Figure 2A was selected to determine whether the 
behaviour of institutions reflected a rapid onset of policy creation followed by little ad¬ 
ditional policy-creation activity. The (5) sigmoid function and (6) logistic function reflect 
variants on a pattern of behaviour consistent with a small volume of policy creation, fol¬ 
lowed by a rapid increase in creation, then a period of stabilization. As can be seen in 
Figure 2B and 2C, the sigmoid function would reflect an earlier onset of policy creation 
followed by a slow period of increase, whereas the logistic function would reflect a later 
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onset of policy creation and a more abrupt increase. (7) Finally, the sigmoidal hill func¬ 
tion in Figure 2D reflects a period of stability and inactivity, followed by rapid policy cre¬ 
ation, then another period of stability without any further policy creation. 

a 

y = yo + aln* y ~ p-*oY :i 

1 + coV b ) 



A B 



C D 


Figure 2. Representative functions consistent with (a) logarithmic, (b) sigmoid, (c) logis¬ 
tic, and (d) Hill models. Figures adapted from SigmaPlot 11.0. 

An examination of the R 2 in Table 1 suggests that all of the seven candidate functions 
fit the data reasonably well, but that the three-segment linear function, the sigmoid func¬ 
tion, and the logistic function provide the best fit. Despite the high correlation of the 
three-segment linear function, its superior fit is likely a result of the number of model 
parameters used (see Table 1) and so does not reflect the best model. To rule out the 
influence of the number of model parameters in our functions, we used Akaike’s Infor¬ 
mation Criterion (AIC) as a goodness-of-fit index to compare models and correct for the 
number of parameters (Burnham & Anderson, 2002). A correction was used to account 
for the small sample size (32 documents) due to the limited number of policy-creation 
dates: AICc = n-ln(RSS/n) + 2 -K+( 2 -K-(K + i))/(n-K -1)), where RSS is the residual sum 
of squares, n is the number of data points (policy creation dates), and K is the number of 
parameters within the model. 

A comparison of the AICc for each model provided a difference score— AfAIC)— re¬ 
flecting the extent to which the fits of the alternative functions deviated from the best-fit 
sigmoid function. These scores were then standardized to obtain Akaike weights (iu), a 
measure providing the probability that a given function accurately reflects the observed 
pattern in the data (Wagenmakers & Farrell, 2004). The Akaike weights also support the 
general observation that both the sigmoid and the logistic functions provide the best fit 
to the data. Moreover, by computing a confidence set (Royall, 1997), we were able to de¬ 
termine which functions were within 10% of the highest Akaike weights, thereby account- 
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ing for a similar proportion of variance in the data. As both the sigmoid and the logistic 
functions meet this cut-off, they cannot be distinguished from one another, confirming 
that they fit the data equally well. The AICcs in Table l support the conclusion that both 
functions provide the best fit to the data, with a small, non-significant advantage for the 
sigmoid function. Once the number of parameters is accounted for, the three-segment 
function does not fit the data any better than the other candidate models. 

Demonstrating that the sigmoid and the logistic functions provide the best fit for the 
policy creation date data has important implications for understanding the kind of behav¬ 
iour engaged in by Canadian academic institutions in their RIM policy development. The 
non-fit of the linear function suggests that the creation of RIM policies was not guided by 
a progressive increase in institutional policy creation; the two- and three-segment linear 
functions also provided a poorer fit, suggesting that multiple, linear behavioural patterns 
were not at work. Similarly, the failure of the logarithmic function to fit the data suggests 
that RIM policy creation was not characterized by a period of inactivity, followed by a 
sudden burst of policy development after the release of the TCPS-IRS in 1994, and then 
a steady rate of policy creation. Finally, the failure of the Hill function to fit the data sug¬ 
gests that a pattern characterized by rapid policy creation followed by a period of stabili¬ 
zation does not explain RIM policy creation in Canadian academic institutions. 

Our finding that the sigmoid and logistic functions fit Canadian RIM policy creation 
dates suggests a very specific pattern of behaviour characterizing the Canadian research 
integrity landscape. Both of these functions show slower initial onsets followed by a rapid 
series of policy-creation events, which are in turn followed by a slower decline in policy- 
creation activity. The fits of these functions with the data suggest a pattern wherein some 
universities (e.g., McGill) preceded the general trend in Canada and therefore were likely 
responding to external influences (e.g., American or Tri-Council initiatives). Similarly, the 
later development of policies after a rapid period of policy creation suggests that institu¬ 
tions either resisted change or could not mobilize policy responses. The fact that there is at 
least a measure of variability in these data conforms to the general suggestions of the policy 
implementation literature that macro-level policy creation can produce varied responses 
at the local level. This conclusion is also reflected in the content of these policies (Schoen¬ 
herr & Williams-Jones, 2011), which shows an evolutionary process wherein policies were 
developed to fit a particular niche within the academic culture of a particular institution. 

Deviation from Tri-Council inception date. To examine whether the trend of poli¬ 
cy creation around the 1994 release of the TCPS-IRS was statistically significant, all creation 
dates were entered into a chi-squared test. This analysis revealed a significant difference 
for the frequency of policy creation dates, X 2 (8) = 42.813, p < .001, confirming that there 
was systematic variability in terms of when RIM policies were created. Moreover, a one- 
sample f-test was performed on the data to examine whether the mean policy creation date 
(= 1995.2, SD = 4.03) differed from 1995, respectively. No significant difference was found 
when 1995 was used as the criterion year, £(31) = .263, p = .794, suggesting that policy cre¬ 
ation dates were not significantly different from 1995. By contrast, a significant difference 
was observed when both 1997, f(3i) = -2.546, p = .016, and 1999, f(3i) = -3.950, p < .001, 
were used as the criterion years. Taken together, these results suggest that the TCPS-IRS 
creation date represents a specific landmark, but that the TCPS-FIR in 1996 and the TCPSi 
in 1998 did not have a significant impact on RIM policy creation in Canadian institutions. 
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Table 1. 

Curve Estimates from Functions for Policy Creation Dates 


Model 

RSS 

AICc 

A/AIC) 

w.(AIC) 

R 2 

Cl 

l-Segment Linear (2) 

260.35 

36.28 

10-55 

0.005 

0.80 

0.05 

Logarithmic (2) 

260.18 

36.28 

10.54 

0.005 

0.80 

- 

Sigmoid (3)* 

47-30 

25-73 

0.00 

1.000 

0.96 

- 

Logistic (3) 

47-32 

25-74 

0.00 

0.998 

0.96 

- 

2-Segment Linear (4) 

218.41 

46.70 

20.97 

0.000 

0.82 

- 

Hill (4) 

253-42 

48.04 

22.31 

0.000 

0.80 

- 

3-Segment Linear (s) + 

24.27 

62.93 

37.20 

0.000 

0.98 

- 


Proportion of variance accounted for by the respective curves and critical value. The superscripted plus in¬ 
dicates the model with the highest correlation, and the asterisk indicates the best-fitting function in terms 
of AICc and weighted difference scores. The number of model parameters are contained within parenthe¬ 
ses, in the first column. 

FRSQ Provincial Policy Initiative: Creation Date 

The significance of the TCPS-IRS release in 1994 seems clear, given the mean and 
modal values of policy dates. An alternative hypothesis, though, is that provincial policies 
could have a significant and maybe even more important impact on RIM policies. To test 
this hypothesis, we examined the policy creation dates of institutions in the province of 
Quebec, for two reasons. 

First, given that French is the official language in Quebec—as compared with English in 
the rest of Canada, with the exception of New Brunswick, which is officially bilingual—this 
linguistic difference could make provincial policies more relevant than federal policies. 
Thus, although the culture of science might be identified by at least some universal norms 
(see, e.g., Merton, 1942/1973, 1957; cf. Ziman, 2000), their instantiation and communi¬ 
cation through institutional policies are likely to be shaped by the relationship between 
higher education institutions and regional government. Second, during the period of RIM 
policy creation examined in our study, a similar but far more inclusive set of standards 
related to the TCPS-IRS was developed by Quebec’s health research funding agency, the 
FRSQ. In addition to the Plan (Faction ministeriel en ethique de la recherche et en in¬ 
tegrity scientifique (PAM; Gouvernement du Quebec Ministere de la Sante et des Services 
sociaux, 1998), comprehensive measures were outlined by FRSQ in the Guide d’ethique de 
la recherche et d’integrite scientifique (Guide; Fonds de la recherche en sante du Quebec, 
2003). Finally, given that the basis of the legal system in Quebec (civil law, modeled on 
that of France) differs from what is used in the rest of Canada (common law, following that 
of the UK and other Commonwealth countries), we might expect legal standards in Quebec 
to be accommodated in RIM policies in a different manner than elsewhere in Canada. 

However, when subjected to the same general analysis as for the other RIM policies, our 
data do not suggest that the FRSQ policy had a statistically significant impact. Of the poli¬ 
cies implemented by Quebec institutions in our study (n = 8), the majority were created in 
the same period as in all other Canadian institutions (Mo = 1995; Mdn = 1995), with only 
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one policy created after this date. Given that neither the date of the PAM (Gouvernement du 
Quebec Ministere de la Sante et des Services sociaux, 1998) nor the date of the more spe¬ 
cific Guide (Fonds de la recherche en sante du Quebec, 2003) aligns with these numbers, 
it is reasonable to conclude that these provincial documents were not the primary impetus 
for institutional policy creation in Quebec. This suggests that federal rather than provincial 
guidelines are the principle reason for Canadian institutions’ creation of RIM policies. 

In a similar fashion to the overall analysis, all creation dates for Quebec institutional 
RIM policies were entered into a chi-squared test. Due to the restricted range and small 
sample size, no significant difference was found between the policy creation dates, X 2 (3) = 
6.00, p = .112, nor was any significant difference found between the mean policy creation 
date (= 1996, SD = 4.11) and 1995 as the criterion year, t(y) = .689, p = .513. Analyses of 
the years immediately following the PAM release in 1998 revealed a marginally significant 
difference for 1999, t(y) = -2.067, P = -078, and a significant difference for 2004, t{j) = 
-5.511, p < .005. Thus, while it might be reasonable to assume that the Quebec Ministry 
of Health’s PAM could have had an impact on policy creation dates, this does not appear 
to have been the case. Again, our data indicate that the creation of the TCPS-IRS in 1994 
represents a specific landmark for scientific integrity policies across Canada. We must 
interpret these data cautiously, given the small sample size available for analysis. 

Institutional policies are rarely static but are instead occasionally (although not fre¬ 
quently) modified to respond to emerging challenges. So, it is possible that provincial 
guidelines that followed federal policies might have informed later changes to the RIM 
policies of Quebec institutions. Moreover, if, as our data suggest, federal initiatives are 
the principle drivers of policy creation and modification, then the release of the TCPS-FIR 
and revisions to the TCPSi should also be visible within institutional policy modification 
dates. The analysis presented in the next section considers what factors might have af¬ 
fected later RIM policy modifications. 

Policy Modification Dates 

The first notable property in the distribution of modification dates in our study sample 
is the relative lack of variability. Of the 32 documents with creation dates that we as¬ 
sessed, only half (n = 16) appear 4 to have been modified in the date range examined (i.e., 
1985 to 2006), as evidenced by the lack of modification dates cited within these docu¬ 
ments. In this case, the mode (Mo = 2004) and median ( Mdn = 2000) modification dates 
differ more substantially than in the previous creation-date analysis. Supporting the lack 
of variability in the modification of Canadian RIM policies, a chi-squared analysis did not 
reveal a significant difference for these frequencies, X 2 (io) = 3.25, p = .975. Given that 
no general difference was observed, no further analyses were conducted. The analysis of 
Quebec policies is discussed below only in descriptive terms. 

The lack of subsequent policy events affecting Canadian institutional RIM policies is 
also evidenced by the fact that only two policies were modified in the 1996-1997 period, 
suggesting that the release of the TCPS-FIR had little effect on Canadian institutions. This 
finding is particularly surprising given the greater clarity that these guidelines appear to 
provide in terms of the content (recommendations for specific procedures) for institutional 
RIM policies. In Quebec, however, there is some evidence for the influence of provincial 
policies. The majority (n = 5) of policy modification dates were during or after the release 
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of the PAM in 1998, with two documents being revised in 2004 after release of the Guide in 
2003. Drawing solid conclusions about the influence of the PAM is nonetheless somewhat 
problematic; due to the small number of policies in our sample that were modified, we can¬ 
not determine whether there are statistically significant trends. If, however, we extrapolate 
from the general trend evidenced in policy creation dates, then we would not expect con¬ 
siderable modification in Quebec institutional policies to have followed the release of the 
TCPS-FIR, although provincial standards might still have affected policy modifications. 

Considerations and Criticisms 

Some important limitations of our analyses should be noted. Our study only exam¬ 
ined the creation of (1) federal research integrity policies and (2) the policies of a single 
province, Quebec, the latter as a case study that might demonstrate a divergent trend 
in policy-creation activity. This was a reasonable approach given that some institutional 
RIM policies explicitly cite the policies or guidelines of research funders as a key consid¬ 
eration (Schoenherr & Williams-Jones, 2011). However, we in no way wish to claim that 
the TCPS-IRS is the only factor that affected the creation of RIM policies. One of the first 
RIM policies in Canada, that of McGill University, was created in 1985, a date that coin¬ 
cides with the American federal initiatives noted above. Nonetheless, the fact that aside 
from this one outlier, the majority of RIM policies were created after the TCPS-IRS in 
1994 is strong evidence that federal granting agencies represented a central motivation 
for institutional policy change. 

When cautiously interpreted, the pattern of results evidenced in Canadian RIM pol¬ 
icies provides evidence for models of organizational change (e.g., DiMaggio & Powell, 
1983; Kraatz & Zajac, 1996). With the exception of a few institutions, the majority of 
Canadian universities produced policies within a year of the TCPS-IRS release. This is 
consistent with models of organizational change that emphasize adaptive similarity as a 
response to institutional competition (DiMaggio & Powell, 1983; Meyer & Rowan, 1977). 
In the present case, this competition represents compliance in order to continue receiving 
research funding, while also likely reflecting the desire to maintain institutional legiti¬ 
macy (Meyer & Rowan, 1977; Suchman, 1995). However, in our previous study of RIM 
policy content (Schoenherr & Williams-Jones, 2011), we found evidence of considerable 
variability in terms of what policy elements were included (e.g., types of behaviour classi¬ 
fied as research misconduct, explicit reference to national standards). Such deviation can 
be taken as evidence that institutional decision makers have attempted to accommodate 
the stakeholders and competencies of their organizations (e.g., Cohen, et al. 1972; Kraatz 
& Zajac, 2001), and it supports the role of institutional culture in organizational change 
within higher education (e.g., Kezar & Eckel, 2002). In general, idiosyncrasies evidenced 
within institutional policies, and pressure to adapt to global features of the policy land¬ 
scape, suggest that RIM policy development can be accounted for by evolutionary models. 
Before drawing generalizable conclusions about the impact of federal agencies on science 
policy, we would need further evidence in other related policy areas, such as research eth¬ 
ics involving human participants, or conflict of interest—e.g., following the creation of the 
TCPSi in 1998, its major revision (TCPS2) in 2010, and the update in 2014. Moreover, 
studies of the decision-making process are required to discern what factors determine 
and define this process (e.g., Volberda & Lewin, 2003). 
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A related concern stems from the quantitative technique that we employed, i.e., diffu¬ 
sion modelling (Rogers, 2003; Valente, 1995). One might argue that directly contacting 
university administrators involved in the creation of RIM policies to investigate their mo¬ 
tivations would have been a more effective means of assessing the impact of the TCPS-IRS 
or other federal and provincial initiatives (HAL, 2009). While such an approach would 
clearly provide rich and pertinent information and certainly warrants further research, it 
does not undermine the utility of our approach, which was consciously chosen because 
of its more distal nature. By assessing policy-creation dates, we removed ourselves from 
the assumptions that an informant would provide accurate and unbiased information 
about the underlying motivations for policy creation. Moreover, using techniques similar 
to those we employed in our study, it would be possible to conduct meaningful compari¬ 
sons between international policy-development initiatives on research integrity. Added to 
these studies, research should also assess the extent to which policy implementation has 
been effective in ameliorating cases of misconduct. In the Canadian context, this would 
benefit from the retention of statistics by an autonomous organization similar to the ORI 
in the United States. 


Conclusion 

In the present study, we considered one possible factor in the creation of RIM policies 
at Canadian academic institutions: the actions of government funding agencies at both 
the federal and the provincial (specifically Quebec) levels. Our results provide compelling 
evidence that soon after the release of the TCPS-IRS in 1994, most Canadian universities 
quickly followed suit by creating RIM policies in or around 1995. Moreover, we observed 
that provincial guidelines released by the province of Quebec, i.e., the PAM in 1998 and 
the Guide in 2003 (which provide comprehensive policies on research integrity and re¬ 
search ethics), did not have as large an impact on the creation of policy documents in 
Quebec-based institutions but might nonetheless have affected subsequent modifications 
to policies within the province. Taken together, this suggests that the 1994 federal initia¬ 
tive to establish national guidelines addressing research integrity played an important 
role in changing the RIM policy landscape in Canada. In this sense, the Tri-Council has 
performed a role similar to that of the ORI in the United States. This similarity, however, 
must not be exaggerated, given that the ORI’s role has been one of enforcement (i.e., it 
has policing powers, including an investigative branch) and the development of a com¬ 
prehensive research program and educational initiatives. Neither do we mean to suggest 
that the inception of the TCPS-IRS is the only or primary reason for policy creation. It is 
possible that a need for change was present within the higher education community and 
that the actions of the Tri-Council proved to be the final impetus for creation. Neverthe¬ 
less, institutional responsiveness to federal policy development indicates a potentially 
strong and positive role for national agencies (e.g., Kondro, 2007). The finding that uni¬ 
versities are affected by federal policy does not, of course, in any way imply that national 
standards are sufficient or appropriate. Steneck (1999) articulated this point particularly 
well when he noted that “‘change’, however, is not the same as ‘accomplishment’. Change 
simply means that conditions before and after are not the same. Accomplishment is ef¬ 
fecting change for a purpose” (p. 162).^ 
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Notes 

1. These correspond to what DiMaggio and Powell (1983) referred to as coercive and 
normative pressures in isomorphic organizational change. 

2. It is worth noting that in contrast to the Tri-Councils, which separated policies on 
research integrity (i.e., the TCPS-TAF) from those dealing with research ethics for hu¬ 
man subjects (i.e., TCPS1/2), Quebec policies have tended to address both mandates 
within the same document. 

3. With the reorganization the three Quebec funding councils in 2010—i.e., the creation 
of a centralized Fonds du recherche du Quebec, but with individual councils still in 
charge of grant programs—there has been a move to harmonize policies, including 
those for research ethics and integrity. A new policy on the responsible conduct of 
research —Politique sur la conduite responsable en recherche— was published in Sep¬ 
tember 2014. 

4. Based on explicit modification dates included in the published policies. 
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